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Claims 



We claim: 

1 LA method for analyzing a continuous compressed video according to a plurality 

2 of states, comprising: 

3 extracting a set of domain specific features from fixed-length sliding 

4 windows of frames of the continuous compressed video; 

5 determining a set of maximum likelihoods for each set of domain specific 

6 features using a plurality of sets of trained hidden Markov models; and 

applying dynamic programming to each set of maximum likelihoods to 
3 determine a specific state for each fixed-length sliding window of frames of the 
J® continuous compressed video. 
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1 2. The method of claim 1 wherein the extracting further comprises: 
determining a dominant color ratio from each frame; and 
determining an average motion intensity from each frame. 



1 3. The method of claim 2 wherein the dominant color ratio is 
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\P\ 

3 where P is a set of all pixels in each frame, and Pd is a set of pixels with a 

4 dominant color in each frame. 



18 



MH-5087 
Divakaran et al. 



1 4. The method of claim 2 wherein the average motion intensity is 

2 m = -^—YJv 2 +v 2 , 

IOIT V x y 

3 where G> represents a number of macro-blocks in each frame, and v = [v , v ] is a 

x y 

4 motion vector for each macro-block. 

1 5. The method of claim 1 wherein a length of the window is in the range of one to 

2 five seconds. 

6. The method of claim 1 wherein the window slides forward in one second steps. 

j 7. The method of claim 1 further comprising: 

smoothing the set of domain specific features with a temporal low-pass 
filter; and 

normalizing the set of domain specific features with regard to a mean and 
variance of the entire set of domain specific features. 

8. The method of claim 1 wherein the plurality of sets of hidden Markov models 
are trained with a training video having frames with known states. 

9. The method of claim 1 wherein each set includes six hidden Markov models. 

10. The method of claim 1 wherein the states are P and B, and the sets of hidden 
Markov models are 

n = Q P Un B ={Pl...Pn;Bl...Bn}. 
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1 11. The method of claim 10 wherein the set of maximum likelihood for each set of 

2 domain specific features is 

3 Q P (t) = max {Q Pi (t)}, Q B (i) = max {Q m (t)} 9 i= 1, 6. 

1 12. The method of claim 1 wherein the domain specific features are modeled as a 

2 mixture of Gaussian distributions. 

1 13. The method of claim 1 wherein each set of the maximum likelihoods form a 

2 trellis grid, and the specific state corresponds to an optimal path through the lattice 

|| 14. The method of claim 13 wherein the trellis grid corresponds to states of the sets 

if of hidden Markov models and state transitions of the hidden Markov models. 

Jj 15. The method of claim 1 further comprising: 

ffl segmenting the continuous compressed video according to the specific 

S*i 

S states. 

1 16. The method of claim 1 wherein the continuous compressed video is of a 

2 sporting event, and a dominant color ratio for each frame is determined from a 

3 color of a playing field, and an average motion intensity is determined from motion 

4 vectors of macro blocks of each frame. 

1 17. The method of claim 16 wherein the sporting event is a soccer game, and the 

2 color is green. 
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18. The method of claim 16 wherein the states are play and break. 

19. The method of claim 10 wherein the continuous compressed video is of a 
soccer game, and a dominant color ratio for each frame is determined from a green 
color of a playing field, and an average motion intensity is determined from motion 
vectors of macro blocks of each frame, and the states P and B are play and break in 
the soccer game. 
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